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Abstract 

A new understanding of the notion of the stable solution to ill-posed problems 
is proposed. The new notion is more realistic than the old one and better fits 
the practical computational needs. A method for constructing stable solutions in 
the new sense is proposed and justified. The basic point is: in the traditional 
definition of the stable solution to an ill-posed problem Au = /, where ^ is a linear 
or nonlinear operator in a Hilbert space H, it is assumed that the noisy data {fs, 5} 
are given, ||/ — /<5|| < 6, and a stable solution us := Rsfs is defined by the relation 
lim5_j.o \ \R5f5 — y\ \ = 0, where y solves the equation Au = f, i.e., Ay = f. In this 
definition y and / are unknown. Any / G B(fs,6) can be the exact data, where 
B{fs,S) :={/: <<5}. 

The new notion of the stable solution excludes the unknown y and / from the 
definition of the solution. 



1 Introduction 

Let 

Au = f, (1.1) 

where A : H ^ H is a. linear closed operator, densely defined in a Hilbert space H. 
Problem (11.11) is called ill-posed if A is not a homeomorphism of H onto H, that is, either 
equation (11.11) does not have a solution, or the solution is non-unique, or the solution 
does not depend on / continuously. Let us assume that (11.11) has a solution, possibly 
non-unique. Let N{A) be the null space of A, and y be the unique normal solution to 
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f ll.ll) . i.e., y ± N{A). Given noisy data fs, \\fs — f\\ < S, one wants to construct a stable 
approximation ug := Rsfs of the solution y, \\us — |/|| — >■ as 5 — t- 0. 

Traditionally (see, e.g., one calls a family of operators Rh a regularizer for problem 
f ll.ll) (with not necessarily linear operator A) if 

a) RhA{u) — as /i — )■ for any u G -0(^4), 

b) Rhfs is defined for any fsEH and there exists h = h{6) — ?■ as 5 — such that 

\\Rh(S)f5-y\\ ^0 as 6 ^0. (*) 

In this definition y is fixed and Q must hold for any fs G B{f, 6) := {fs ■ \\fs — f\\ < S}. 

In practice one does not know the solution y and the exact data /. The only available 
information is a family fs and some a priori information about f or about the solution 
y. This a priori information often consists of the knowledge that y E where /C is a 
compactum in H. Thus 

ye 85:= {v. \\A{v)-fs\\<5, veK}. 

We assume that the operator A is known exactly, and we always assume that fs G S(/, ^), 
where / = A{y). 

Definition: We call a family of operators R{6) a regularizer if 

sup \\R{d)f5 - v\\ < r]{6) ^0 as 6^0. (1.2) 

v&Ss 

There is a crucial difference between our new Definition (11. 2|) and the standard definition 
©: 

In u is fixed, while in (11. 2p v is an arbitrary element of Ss and the supremum of 
the norm in (II. 2p over all such v must tend to zero as 6 —> 0. 

The new definition is more realistic and better fits computational needs because not 
only the solution y to (11.11) satisfies the inequality HAy — /^H < 6, but any v e Ss satisfies 
this inequality \\Av — fs\\ < S, v E IC. The data fs may correspond to any / = Av, where 
V G Ss, and not only to / = Ay, where y is a solution of equation (1.1). Therefore it is 
more natural to use definition (II. 2p than (jlj). 

Our goal is to illustrate the practical difference between these two definitions, and to 
construct regularizer in the sense (11.21) for problem (II. Ij) with an arbitrary, not necessarily 
bounded, linear operator A, which is closed and densely defined in H. This is done in 
Section 2. In Section 1 this is done for a class of equations (II. ip with nonlinear operators 
A : X Y, where X and Y are Banach spaces. In this case we assume that 
Al) A : X ^ Y is a closed, nonlinear, injective map, f G TZ{A), TZ{A) it is the range of 
A, 

and 

A2) (j) : D{(j)) [0, 00), (piu) >0 ifu^O, D{4>) C D{A), the sets ]C = JC^ := {v: 0(f) < 
c} are compact in X for every c = const > 0, and ifvn — )■ v, then (f){v) < liminf„_^oo 0('^n)- 
The last inequality holds if (j) is lower semicontinuous. In Hilbert spaces and in 
reflexive Banach spaces norms are lower semicontinuous. 
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Let us give some examples of equations for which assumptions Al) and A2) are 
satisfied. 

Example 1. A is a linear injective compact operator, / G TZ{A), (p{v) is a norm on 
Xi C X, where Xi is densely imbedded in X, the embedding z : Xi — )■ X is compact, 
and (p{v) is lower semicontinuous. 

Example 2. A is a nonlinear injective continuous operator / G TZ{A), is not 
continuous, <p is as in Example 1. 

Example 3. A is linear, injective, densely defined, closed operator, / G 7^(A), A"^ is 
unbounded, is as in Example 1, Xi C D{A). 

Let us demonstrate by Example A that a regularizer in the sense ([*]) may be not a 
regularizer in the sense {\1.2\i . 

In Example B a theoretical construction of a regularizer in the sense flL2p is given for 
some equations (11. ip with nonlinear operators. 

In Section 2 a novel theoretical construction of a regularizer in the sense (II. 2p is given 
for a very wide class of equations (II. ip with linear operators A. 

Example A: Stable numerical differentiation. 

In this Example the results from [3] - [H] are used. This Example is borrowed from 



The data are: fs and a constant Ma, which defines a compact /C, where \\fs — f\\ < 6, the 
norm is L°^(0, 1) norm, and K, consists of the L°° functions which satisfy the inequality 
ll'^^IU < Ma, a> 0. The norm 



Consider stable numerical differentiation of noisy data. The problem is: 




(1.3) 



u{x) - u{y)\ 



+ sup \u{x)\ if < a < 1 

0<x<l 



U 



:= sup 

x,ye[0,l] 



x-y 



a 



sup (|'u(2;)| + |n'(x)|) + sup 

0<x<l x,ye[0,l] 

xj^y 



u'{x) - u'{y)\ 



1 < a < 2. 



a 



X-y 



If a > 1, then we define 




h{S) < X < 1 - h{5) 
0<x < h{d), 
1 - h{6) <x<l, 



(1.4) 



where 



h{S) = CaS-, 



(1.5) 



and Ca is a constant given explicitly (cf [1]). 
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We prove that fll.4p is a regularize! for fll.3p in the sense f ll.2l) . and /C := {v : < 
Ma, a > 1}. In this example we do not use lower semicontinuity of the norm (p{v) and 
do not define 0. 

Let Ss,a '■= {v '■ \\Av — < S, \\v\\a < Ma}. To prove that fll.4p - fll.5p is a regularizer 
in the sense f ll.2p we use the estimate 

sup \\R{6)fs - v\\ < sup {\\Rid)ifs - Av)\\ + \\Ri6)Av - v\\} < J- + Mah^-\6) < 

< Ca5^-^ := r]{6) as 5 ^ 0. 

(1.6) 

Thus we have proved that f ll.4p - fll.5p is a regularizer in the sense (11.20 . 
If o = 1, and Ml < 00, then one can prove the following result: 
Claim: There is no regularizer for problem (II. 3p in the sense (II. 2p even if the regu- 
larizer is sought in the set of all operators, including nonlinear ones. 

More precisely, it is proved in [5], p. 345, (see also [8], pp 197-235, where the stable 
numerical differentiation problem is discussed in detail) that 

inf sup \\R{6)fs - v\\ > 0, 

where c > is a constant independent of 6 and the infimum is taken over all operators 
R{S) acting from L°°(0,1) into L°°(0,1), including nonlinear ones. 

On the other hand, if a = 1 and Mi < 00, then a regularizer in the sense Q does 
exist, but the rate of convergence in (*) may be as slow as one wishes, if u{x) is chosen 
suitably (see [H])- 

Example B: Construction of a regularizer in the sense (II. 2p for some nonlinear 
equations. 

Assuming Al) and A2), let us construct a regularizer for (11.10 in the sense (II. 2p . We 
use the ideas from [lOj and [H]. 

Define Fs{v) := \\Av — fs\\ + S(j){v) and consider the minimization problem of finding 
the infimum m{6) of the functional Fs{v) on a set Ss'. 

m{5) := inf Fsiv), Ss := {v : \\Av - fs\\ < 5, 0(^;) < c}. (1.7) 

v&Ss 

Here 

K = Kc := {v : (f){v) < c}. 

The constant c > can be chosen arbitrary large and fixed at the beginning of the 
argument, and then one can choose a smaller constant Ci, specified below. Since Fs{u) = 
6 + 64>{u) := Ci6, Ci := 1 + 0(w), where u solves (II. ip . one concludes that 

m{6) < ci6. (1.8) 

Let Vj be a minimizing sequence and Fs{vj) < 2m{6). Then (p{vj) < 2c\. By assumption 
A2), as j — )■ 00, one has: 

vs, (j){vs) < 2ci. (1.9) 



4 



Take S = 6m and denote vs„^ ■= Wm- Then fll.9p and Assumption A2) imply the 
existence of a subsequence, denoted again Wm, such that: 

Wm^w, A{wm)^A{w), \\A{w) - g\\ = 0. (1.10) 

Thus A{w) = g and, since A is injective by Assumption Al), it follows that w = u, where 
u is the unique solution to (11. ip . 

Define now R{S)fs by the formula R{6)fs := vs, where vs is defined in fll.Qp . 

Theorem 1.1. R{6) is a regularizer for problem (11. Ij) in the sense ( \1.2\] . 

Proof. Assume the contrary: 

sup \\R{S)fs — f II = sup \\vs — f II > 7 > 0, (1-11) 

veSs veSs 

where 7 > is a constant independent of 6. Since (p^vs) < 2ci by (II. 9p . and (j){v) < c, one 
can choose convergent in X sequences Wm '■= vs^ w, 6m, ^ 0, and Vm ^ v, such that 
\\wm — Vm\\ > 2 ' 11^ ~ "^11 — 2' A{w) = g, A{v) = g. By the injectivity of A it follows 
that w = V = u. This contradicts the inequality \\w — v\\ > ^ > 0. This contradiction 
proves the theorem. 

The conclusions A{w) = g and A{v) = g, that we have used above, follow from the 
inequalities ||v4(t>5) — fs\\ < 5 and \\A{v) — fs\\ < S after passing to the limit (5 — )■ 0, using 
assumption A2). □ 

2 Construction of a regularizer in the sense ( 11.21} for 
linear equations 

If A is a linear closed densely defined in H operator, then T = A*A is a densely defined 
selfadjoint operator. Let := T + al, where a = const > 0. The operator T~^A* is 
densely defined and closable. Its closure is a bounded operator, defined on all of H, and 
11^)7^^*11 < See [12]-[15] for details and other results. Let Eg be the resolution of the 

identity of the selfadjoint operator T, dp := d{Esy,y), and )C := {u : s~'^^dp < k^}, 
where p G (0, 1) and kp > are constants. 
Our basic result is: 

Theorem 2.1. The operator Rg = T~^l^A* is a regularizer for problem (II. ip in the 

sense (ll.2p z/hm^^o ^^^^1/2 = and lims^-^o a{S) = 0. Moreover, if a{5) = bp6'^p+^ , then 



2p 



where 



sup \\Ri5)fs-y\\<Cp6^^, (2.1) 
yeic,\\Ay-fs\\<s 



Cp = —= + CpkpbP Cp = pP{l - pf f , bp ■= (Apcpkp) 
2^bp 
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The above choice of a{5) is optimal in the sense that the right-hand side of fl2.2l) (see 
below) is minimal for this choice of a{6). 

Proof. 

Let 

e := sup \\T^^A*fs~y\\:=snp\\T-^A*fs-y\\. 
yeic,\\Ay-fs\\<s 

Then, with Ay = f, one has 

e < snp\\T-'A*{fs - f)\\ + sup \\T-' A* Ay - y\\ := J, + J,, 

where 



27^' 

and 

J2 < sup{a^\\T^^y\\^} < sup / —^-—,d{Esy,y). 



Thus, 



j2< (max— )V^cW^ 
^ ~ ^ s>o a + P P ^ 



because maXs>o ^ is attained at s = and is equal to CpCt'', where 

POD 

Cp:=fil~py-P, kl:=snp / s-'^diE.y^y). 

yeJC Jo 

Consequently, 

J2 < Cpkptt'', 

and 

e < + CpkpaP. (2.2) 
a 

Minimizing the right-hand side of fl2.2p with respect to a > 0, one obtains inequality 

(EH). 

The minimizer of the right-hand side of (12. 2 j) is 

2 _ 2 

a = a{5) = bp52p+^ , bp:= {ApCpkp) 2p+i , 

2p 

and the minimum of the right-hand side of (12. 2j) is Cp^^p+i^ where 

Cp := + CpkpF^. (2.3) 
Theorem 2.1 is proved. □ 
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